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ABSTRACT 


The uncertainty associated with a least-squares fitted polynomial is a 
function of the standard deviation of the data noise, the correlation of the data 
noise, the degrees of freedom of the polynomial, and the number of data 
points. The standard deviation and the rms standard deviation of the poly- 
nomial are therefore better measures of data quality and the information con- 
tained in the data than the commonly used residuals from a least- square fitted 
polynomial. 

The standard deviation 17. and the rms standard deviation rj of least- 
squares fitted polynomials are analyzed in this paper. The general equations 
derived are demonstrated on several Apollo tracking problems: 

It is shown that rj does not improve for higher sampling rates of 
angular data than 2 or 5 per second, for narrow and wide bandwidth 
setting of the angular servoloops, respectively. (Apollo GO, NO-GO 
decision.) 

The effect of negative correlation of measurement errors is ana- 
lyzed. The effect of phase noise in range rate data is reduced by a 
factor ►N due to the negative correlation of -1/2 between adjacent 
measurement points. 

The effect of random-walk phase noise on the range rate data is 
shown to be proportional to the two-way propagation time of the 
signal. 

The maximum error in a least-squares fitted polynomial is also analyzed. 
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EFFECTS OF CORRELATED NOISE WITH APPLICATIONS 
TO APOLLO TRACKING PROBLEMS 


by 

B. Kruger 

Goddard Space Flight Center 


INTRODUCTION 

A frequently used method for evaluation of tracking data is to fit a polynomial y . 

= a 0 + a t i + a 2 i 2 + • • • + a k _j i k_1 (1) 

of degree k - 1 , i.e., with k degrees of freedom, to the N measured data points y . in the least-squares 
sense. The residuals v. 


v i ' Vi ~ Vi 

are then formed and the variance a\ 


N 



is used as a measure of the quality of the data. 


( 2 ) 


( 3 ) 


The basic shortcoming of this method is that does not reflect the amount of information con- 
tained in the data. Due to the noise on the data y. the constants a„ in y L can only be determined 
with limited accuracy; a standard deviation a a can be associated with each a v . Taking the cor- 
relation between the coefficients into account, we can find the standard deviation 17. for the poly- 
nomial y. at point i . It is suggested that 17. is a better measure for the data quality than o- € . The 
variance o\ does not reflect the correlation of the data noise nor the number of data points available. 
On the other hand, 17. is a function of the data noise correlation and the number of data points avail- 
able. In addition, 17. reflects the increased uncertainty due to an increase in k . 

The standard deviation rj. of the polynomial y i and especially the root mean square (rms) Sj 
of 17. , as defined in the section on data with uncorrelated noise, are therefore better and 


1 



more accurate measures of data quality and the information contained in the data than a e 
alone. 

In this paper the relations between the standard deviations of the polynomial are derived for 
correlated and uncorrelated data noise. It is shown that r ti and rj are always proportional to a € and 
that the proportional factors are functions of the data noise correlation, the number of data points, 
and the number of degrees of freedom of the polynomial fit. 

The general equations derived are demonstrated on several Apollo tracking problems. 


THE LEAST-SQUARES FIT 

Let us assume that we have N observed data points y L at equally spaced intervals. The inter- 
vals are normalized to length l without loss of generality. A polynomial 

y. = 3 0 + 3, i + a 2 i 2 + . . . + a kM i k_1 (4) 

is fitted to the data by the least-squares method. The residuals v L are given by 

v i = Vi " Vi • (5) 

The sum of the residuals squared is minimized by varying the coefficients & v of y.. From 



( 6 ) 


we obtain 


a 0 I i° + Z i + • • • + a k _, I i k "' 1 = Z i°y . 
a 0 2 i + a t Z i 2 + . • • + a k .j I i k = 2 i y. 


a 0 Z i k_1 + a 2 Z i k + . . . + a k _ 1 Z i 2k-2 r i k_1 y. , w 

where all sums are taken from 1 to N. From this set of linear equations the coefficients a t may 
be solved for and inserted in Equation 4. It is shown in Appendix A that the result may conveniently 
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be written in determinant form: 


where 


j=N 

L 

' j=l 


J 'V 


0 1 

1 A o 

1 A i 

42 * 


i k ** 1 A A A 

k”l k k+1 


jk -i 

\ 

A 

k+1 


(8) 


N 

£ , 

i = l 


( 9 ) 


and 


V. 

\ 


|\-1 ^k * * * A 2k"2 I 

For brevity we introduce the notation* |° for the larger determinant so that 



J-l 


y 4 


(io) 


which is the basic equation that will be used for the analysis of the standard deviation 17. of the 
polynomial y . . 


*Note that 


0 

1 


j 

A 


is not a linear operator. 


3 



DATA WITH UNCORRELATED NOISE 


Basic Relations and Definitions 

The measurements y. may be written 




= Y. + e. 


(ID 


where 

Y. = the true value 

e. = measurement error. 


The e. are assumed to be stationary stochastic variables with zero mean and standard devia- 
tion a e . The error Ay. due to the measurement errors e. is obtained by substituting Equation 11 
in Equation 10: 


Ay i = 




( 12 ) 


For uncorrelated noise we have 


icr(C 1 e 1 + C 2 e 2 + . 


•+C N e N )P = ((* + q 




and hence 


where 



rj. = standard deviation of the least-squares fitted polynomial y L at point i. 


In Appendix B, Equation 3, it is shown that 


and thus 


E 



0 i 



(13) 


(B3) 


( 14 ) 
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It is suitable to normalize the measuring interval to unit length by dividing i by N. Furthermore, 
t). is symmetric around i/N = 1/2. A new variable u is therefore introduced: 


i_ _ 1 + u 
N " 2 

and it is shown in Appendix C that, with the approximation 



V + 1 


(15) 


(16) 


Equation 14 may be written 


^-N = P 2 (u) + 3Pj(u) 

cr 2 


(2k + 1) P 2 (u) 


(17) 


where P v are the Legendre polynomials. The error introduced by the approximation 16 is of mag- 
nitude N -2 (see Appendix C) and vanishes, therefore, for large N. 

In Figure 1 the normalized standard deviation 7j n . for y., 





(18) 


is shown graphically for values of k from 1 through 6. We note that, for i/N = 0 or i/N = 1, 


= k 


..o 

1_ N 


(19) 


This result is true for all k, which may be 
shown by expanding Equation 14 in powers of i : 


+ (Aj 3 + A 22 + A 31 ) i 2 + . . .] , (20) 

where A n , A 12 , etc., are the minors of |a| . If 
i = 0 or i = N, 



oi i i i i I 1 1 1 I 1 

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 


I/N 


V 2 
'm 


= N 


._o 

1_ N 


11 

I A i 


Figure 1— The standard deviation 77 . for least-square fit- 
ted polynomials y. f of degree k - 1. The standard devia- 
tion of the data noise iso- e . N = number of data points. 
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It is shown in Appendix D, Equation Dll, that 


A 


11 


£ 

N 


I A | 


and thus 



Sometimes it is necessary to use y i for 
prediction outside the interval of observation. 
An example is the prediction of yearly oscilla- 
tor drift based on one or two months of actual 
observation. Figure 2 shows the rapid increase 
of r) i outside the interval of observation. 

The Root Mean Square 
Standard Deviation 

The standard deviation 77. for the least- 
squares fitted polynomial y. varies with i, as 
can be seen from Figure 1. It is therefore de- 
sirable to define an average standard deviation. 
We choose the root mean square (rms) stand- 
ard deviation rj defined by 



N 


Figure 2 — The standard deviation 77. of the least-squares 
fitted polynomial y. increases rapidly, if y. is used for 
prediction outside the interval of N observed data points. 


N 



i = l 


or, using Equation 14, 



From Appendix B, Equation B4, we obtain 


T) = 



( 21 ) 


( 22 ) 


(23) 


This equation demonstrates a simple relationship between 17 and <? € . For k = 1 we obtain the well- 
known equation for the standard deviation of a time invariant quantity which is measured N times. 
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Because N > k we have 


VSo't 


(24) 


For the normalized rms standard deviation 


we obtain 


or 


V. - 

^ = wZ]^ = k 

\ = ^ • 


(25) 


Note that the Equations 23 and 25 are exact; and no assumptions have been made about the size of 
N. Figure 3 shows the relation between T) and r ti for k = 3 and k = 6. 



Figure 3 — The relationship between the normalized standard deviation ( 7 7 i / cr c ) 1 ^N and the normalized rms 
standard deviation (ri/cr e ) /"N for least-squares fitted polynomials with k degrees of freedom. 
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DATA WITH CORRELATED NOISE 


Basic Relations 

If the correlation coefficient between the noise of measurements y i and y^ +m is p m , then we 
have the basic relation for a stationary process: 


[a(C 1 e 1 + C 2 e 2 + ■ • • C^€ n ) 


|2 - 


22 + 2 ^i 22 c i c i +i + • • • 

_ 1 1 -1 

N-v 

+ 2 P v 22 Ci Ci+V + • • ' + 2P N-1 C 1 C N 


where a e is the standard deviation of errors in the measured values y ; . From Equation 12 for the 
error Ay. in the least-squares fitted polynomial y . , 


Ay. V P i 

1 I A I Z-J U A 

j-i 


(12) 


we thus find the standard deviation 17 . for y . to be 

N , N-l . 

LI" il *-■ E ■ i 


V[ 


|A|2 


j= 1 

N-y 

— E ; i 


j = i 

0 j + v 

1 A 


0 j +1 

1 A 


2 p N _j 


0 1 
i A 


0 N 

1 A 


(26) 


For the root mean square standard deviation r) 


we obtain 


-2 l 

7 ? 2 = 


N N 


EE : i 


+ 2 Pr, 


i=l j=l 


N N ~ ^ 

V -1 


1=1 j=l 


7,2 4 Z] ^ 

i=i 


N N- 


^£Ei°; 

1-1 j-i 


0 3 . 

0 } + V 

i A 

i A 


j + 1 



A 

+ 


° 1 \ • 

0 

N 

1 A l 

i 

A 


( 27 ) 
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In Appendix D it is shown that this equation may be simplified to 


N-l N-l N-l 



where g(k) is a function of k alone. The normalized root mean square standard deviation 


is then 



v 2 = k 


N-l N-l N-l 

i=l i=l i=l 


13 Pi 


(29) 


This is a powerful equation; the use of it will be demonstrated in the following subsections. 


Positive Correlation from System Transfer Functions 

The transfer functions of a system can in most cases be described by an equivalent electronic 
circuit. For instance, the transfer function of an antenna servo is a low-pass filter. If white noise 
is applied to a low-pass filter, the noise at the output terminals will be positively correlated. In 
this section the effects of positive correlation from maximum-flat (Butterworth) filters will be 
analyzed. The autocorrelation functions for the noise at the filter output are summarized in Ref- 
erence 1. Figure 4 shows the autocorrelation function for a single-pole, a double-pole, and an 
"ideal" (infinitely many poles) filter as well as the corresponding electronics circuits. Maximum- 
flat filters are chosen because they commonly occur, they describe most systems adequately, and 
their mathematical treatment is relatively simple. 

The autocorrelation function R(r) of the output noise (for white input noise) for a single-pole 
filter (see References 1 or 2) is 


R(r) - e 


-« C N 


(30) 


where <u c = 3-db angular cutoff frequency of the filter. If the sampling interval is h, then 


and 


p i 


= e 


Pi ~ 




= (p,) 1 , 


(31) 
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1.5 


1.0 


0.5 


0 


Figure 4— Electronic single- and double-pole filters. Normalized autocorrelation functions R(r) 
of white noise passing through maximum-flat filters. 


when /5j 


a; h, and thus 

c 9 


N-l 


£ 


P { 


N-l 

L 

i = l 


Pi (i - p?' 1 ) 
_____ 


But /3j -1 « 1 for large N, so that 



For the sum Sip. we obtain 



For large N, 


N-l 



Pi 

(1 - P ,) 2 ’ 


The sums 2i 3 / o. , etc., may be evaluated in a similar fashion. 
Inserting these results in Equation 29 yields 


ti 2 = k 



2k p \ 

N (1 - P ,) 2 


(35) 


(36) 


and for large N 



(37) 


or 


V 


/EK 

y 1 - pi 


X ’ 


(38) 


where p l = e and rj o stands for the rms standard deviation of the fitted polynomial y 4 for un- 
correlated data noise. 

We see from Equation 38 that the effect of positive correlation e ia>ch is to multiply the rms 
standard deviation obtained for uncorrelated data by the factor 



A maximum-flat (Butterworth) two-pole filter has the normalized autocorrelation function 
(Reference 1). 


sin 

R(t) = 


(“«w cos 7 + ?) 


77 

cos — 

4 


— co |t|cos 7T/4 
e c 


(39) 


and thus 


P i 


(sin i/3, + cos i/3 2 ) e 


(40) 
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where p 2 - co c h/f2. Performing the summation we obtain for large N 


so that 


Thus 


oo 

y 


pi = 


sin /3 2 + cos /S 2 - e 
/ 2 + e'^ 2 - 2 cos 0 2 



sin h fi 2 + sin /5 2 
^ cos h ^ - cos fi 2 


co h a) h 

^sinh — — + sin — — 

„ _ , /2 / 2 _ 

! co h „ h * 

t C C 

cosh — cos 

/2 /2 


(41) 


(42) 


for a two-pole filter and for large N. 

For an ideal filter, i.e., one with infinitely many poles, we obtain from References 1 and 2 


sin co r 
R (r) = — 

CO T 


and hence 


sin 



where j3 t = co c • h. For large N we obtain from Reference 3, page 96 


Also 


L 



* - 01 

Pi 2 / 3 , 



N 




jN/3. 


w 



(43) 


(44) 


(45) 


(46) 
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where j - /-l. Thus 


i im i H ip ' = 0 

N— *oo , — 1 


provided that 1 - e" 3 1 / 0. We thus obtain from Equation 29 


vl 


k _ZL_ 

h 

c 


for an ideal low -pass filter and large N. 


( 47 ) 


The Effect of Sampling Rate on Positively Correlated Data 

An important problem is to find the maximum meaningful sampling rate if the total time of 
observation T is given and the data is positively correlated by a maximum-flat filter as described 
in the preceding subsection. 

For a single-pole filter, Equation 38 may be written 


v 2 


k 1 + Pl 2 

(j ” • 

N 1 - Pj € 


(48) 


The total time of observation is T and the sampling interval is therefore 


h -I 
N 


(49) 


and thus 


A = e 


L 

W c N 


or 




(50) 


Insertion in Equation 39 yields 


77 2 = k- 


O) T 


; hi. hi 

+ 12 180 


(51) 
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From this equation we see that -q does not improve appreciably if (a> c T/N) < 1. In other words, 
little is gained by using a larger number of samples than N max : 


or a sampling rate N/r larger than 


N 


max 


T 


CO 

c 


( 52 ) 


(53) 


Equation 37 may also be written 



1 + e"“'* 


-« JL 
1 - e c N 


and, for N-°d ? 


v 



(54) 


(55) 


where 

a e = standard deviation of the noise of the data 
k = degree of freedom of the least- squares fitted polynomial y. 

= 3-db angular cutoff frequency of the single pole filter 
T = total time of observation. 

Figure 5 shows a comparison between rj for correlated and uncorrelated noise with T = 60 sec 
and o> c = 3 rad/sec. This figure clearly demonstrates that little is gained by exceeding N max . It is 
of interest to note that p. = 1/e % 0.37 for N = N 

From Equation 23 we see that the same rj is obtained for correlated data with N = oo and un- 
correlated data with N = (1/2) N 

For a double-pole filter we obtain from Equations 28 and 41 


v 2 


co T co T 

, c c 

sin h + sin 

k /2 N /2W a 2 

N ' w c ^ 

cos h - cos 

/2 N /2 N 


(56) 
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For the ideal low-pass filter we obtain, from 
Equation 46 for N- c°, 



(58) 


Figure 6 shows the comparison between rj 
for uncorrelated noise and noise correlated by 
a single-pole filter, a double-pole filter, and 
an ideal filter. It is seen that the difference 
between a double-pole and an ideal filter is 
very small. It is therefore sufficient to cal- 
culate with a double-pole filter for practical 
purposes. 



Figure 7 and 8 show rj for single- and 
double-pole filters with T = 60 sec and co c as 
parameter. 


Figure 5— RMS standard deviation V of least-squares 
polynomial fits for uncorrelated and correlated noise. 
The time T of observation is 60 sec, and = 3 rad/sec. 
The number of samples N is varied. 


Example: What is the maximum meaning- 
ful sampling rate for angular data for Apollo 
tracking ships? The transfer function of the 
angle servos is approximated by a two-pole 
filter. 

Expanding Equation 56 into a series we 

find 


1 + 18° 1/2 N/ + 


Somewhat arbitrarily we defined the maxi- 
mum meaningful sampling rate as the rate for 
which rj is within 5 percent of its value for 
N = oo. Thus 


1 

2 


1 

180 



0.05 


(60) 



N 


Figure 6— Comparison of the effect of different filters on 
the rms standard deviation 77 of least-squares fitted poly- 
nomials. White noise is applied to the filters. 
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Figure 7— The effect of filter bandwidth of a single-pole 
filter on the rms standard deviation rj of least-squares 
fitted polynomials. White noise is applied to the filter, 
and the time of observation T = 60 sec. 


Figure 8— The effect of filter bandwidth of a double-pole 
filter on the rms standard deviation 77 of least-squares 
fitted polynomials. White noise is applied to the filter, 
and the time of observation T = 60 sec. 


and 



3 1/2 2 3/4 


(61) 


The Angle Servo Bandwidth may be switched to either 1 Hz or 2.5 Hz (with gyro loop closed) ac- 
cording to Reference 4. We thus obtain from Equation 61 the maximum meaningful sampling rates 
as 2 and 5 samples per second respectively. 


Negative Correlation Range Rate Data 

A typical case of data with negatively correlated noise is range rate measurements in the non- 
destructive Doppler count mode (Reference 5). The Doppler frequency shift is continuously inte- 
grated by means of a counter, and the counter is read out at equal intervals T without destroying 
the information. If the information in the counter is Z., then the range rate R is 


AR 


Ri = _L = c i( z 2 - Zi ) 


AR. 

R 2 =~ = C 1 < Z 3- Z 2^ 


• ar. 

R =c i (z <- z 3> 


(62) 
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etc., where c 1 is a constant. The dominating errors in z. are of two types: a random, zero-mean, 
and uncorrelated noise with constant standard deviation cr N , and a zero-mean random-walk noise 
with standard deviation cr RW which is proportional to the root of time t: 


^RW 


St , 


where c 2 is a constant. 

We will first consider the noise with standard deviation cr N . As the noise is uncorrelated we 
obtain 


a. 1 = c 2 cr 2 

R 1 1 Z 1 


+ c i °i 2 = 2c i a N 


cr. 

RN 


Cr. 


= Cj cr* + CJ a; 
R2 1 z 2 1 3 


(63) 


where 


= the standard deviation of the range rate noise due to cr N . 

The errors in R x and R 2 are correlated because both contain the same error from Z 2 . For this 
reason all adjacent measurements are correlated. Non-adjacent measurements, e.g., R 1 and R 3 , 
are not correlated because they have no error in common. 

From Equation 62 we obtain 


[aCR, + R 2 )l> = cl [a( Z 3 - Z 1 )] 2 = 2c\**=crl N 
[ CT (R, +. ■ .+R n )] 2 = C 2 [o-(Z N -Z 1 )] 2 = 2c 2 cr 2 =cr 2 N . 

But we also have 


(64) 


[a(R, +---+VP = N^ + 2(N - 1) p, , ( 65 ) 

where p 1 is the correlation coefficient between adjacent measurements. The results from Equa- 
tions 64 and 65 have to be identical for all N: 


N + 2(N - 1) p, = 1 • 


( 66 ) 
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Hence 


( 67 ) 


By putting R. = y. we obtain the least-square polynomial y i from Equation 10: 


il'. 

i=i 


( 10 ) 


and the normalized rms standard deviation v n of the polynomial is for large N, from Equation 29, 


7] = k 


['-‘-T B)] 


or 



which also may be written 


( 68 ) 


v 


k 

— cr. 

N RN 


(69) 


It is interesting to compare this result for negatively correlated noise with Equation 23 for 
uncorrelated noise: 



(23) 


We may thus write 



( 70 ) 
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The negative correlation p x - - 1/2 thus re- 
duces the effect of the noise on the rms stand- 
and deviation of y . by a factor /k/N. 

The range rate data also gets an error 
contribution from the random-walk phase 
noise. This contribution is for a coherent 
range rate system proportional to the square 
root of the propagation time T p of the electro- 
magnetic wave going from the tracking station 
to the spacecraft and back again. The standard 
deviation <j j, rw of the error in the R measure- 
ments, caused by random walk, is thus 

^ftRW ~ C 2 ' // ^p ’ (fl) 

The normalized autocorrelation function for 
the range rate is shown in Figure 9. If the pro- 
pagation time T p is p + x sampling intervals, 
where 0 < x < 1, then the correlation coefficients 
are given by 




1.0 r 


0- 5 1 — T p =( P +x)b 


h xh — 



h = SAMPLING INTERVAL 
T p = TWO-WAY PROPAGATION TIME 


- 1 . 0 *- 

Figure 9— Normalized autocorrelation function R(t) for 
range rate measurements (two-way Doppler) contamin- 
ated with random -walk phase noise. 


1 - x 

2 


x 

^p+i 2 

and all other p = 0, as shown in Appendix E. Hence 


(72) 


1 + 2 = 0 


and 


~ 2li p i - p(l -x) + (p + 1) x - T p 


(73) 


From Equation 28 we thus obtain 



a 


2 

feRW 
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With a kRV = c 2 /T, we obtain 


T, = N C a T p ' (74) 

The rms standard deviation of the least-squares fitted polynomial is thus proportional to the prop- 
agation time T p . The effects of the random-walk error are therefore negligible for near-earth 
missions but may be dominating for "Deep Space" missions and galactic probes. 

Negatively Correlated Data; Exponential Autocorrelation Function 

Assume that we have a normalized autocorrelation function 

R(r) = - e'"' H . (75) 


If the sampling interval is h, then 


P i 


/3 

e 


and 


Pi 


e 


where 


Z 3 ! - “c h - 


(76) 


and thus 


N-l 

L 


N-l 


-i/S. 


1 - . 


1 - 1 Pi 


(77) 


for large N in accordance with Equation 32. For the sum 2i p k we obtain, from Equation 35 with N- oo, 



a - Ip, h 2 


(78) 


Insertion in Equation 29 yields, for large N, 


V 



1 - 3 | p, I 
1 - 1 / 0,1 




(79) 
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where v o is the rms standard deviation of y. for uncorrelated noise. The maximum amplitude for 

N is 


(80) 


For this value we obtain from Equation 29: 


v 2 = k 


fl _ l + 2k 31 
L N 4 J 


(81) 


or 



(82) 


Except for a constant multiplier, this equation is identical with Equation 69 for noise, with 
P l = - 1/2 and all other p = Q. 


RELATED TOPICS 

Determination of the Standard Deviation of Noise of Time-Varying Data 

Let Y be a time-varying quantity which is observed at equally spaced time intervals. Without 
loss of generality, we normalize the time interval to 1, and Y will have the value Y . at time i . 
During the observation an error e . is introduced so that the observed value y jL is 

Vi = Y r + • (83) 

The error e. is assumed to be a zero-mean stochastic variable with standard deviation a e . By 
definition, 


N 



1 


when a least-squares polynomial y. of order k - 1 is fitted to the data, the residuals v. can be 
determined: 


v i = Vi - y 4 (85) 

and thus 

e i = v i • ( Y i " Vi) • (86) 
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The conditions for a least-squares fit, Equation 6, may also be written 


N 



1 


From the summation of Equation 86 we obtain 


W N N 

z>z>.-z> -*> 


or, using Equation 87, 




and, by squaring Equation 86 before the summation, 


N N N 

E *i = E *- 2 E ' * <y ‘- 7 ‘ w 

i i i 



If we assume that Y. is generated by a polynomial 


Y. = a A 


+ a. .. 


k-l 


: k-l 


(87) 


( 88 ) 


(89) 


(90) 


(91) 


of degree k-l or lower, then 


Y i ' Yi - (<•<> ~ a o) + (a, - a,) i + • . . + (a k _, - a k .j) i k_1 
and hence, from Equation 87, 


E v * <Y ‘ - 


1 


y £ ) = 


o . 


(92) 
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and Equation 90 reduces to 


L ‘‘ = £ v ‘ * L 


77 \2 


In Appendix F it is shown that 



(93) 


(94) 


if the e. are uncorrelated. 
Hence 


a 


2 

€ 



1 

N - k 



if the are uncorrelated and if Y. is a polynomial of equal or lower degree than y A , 


(95) 


The Maximum Error in a Polynomial Fit 

An interesting question is: What error function produces the largest error in y. if the 
errors are subject to the side condition 



(96) 


where e is a constant? 

Equation 12 may be written 


Ay,, 





Using the method of Lagrange f s multipliers, we obtain for the maximization of A y . 


Be. 

) 



= 0 . 


(97) 


(98) 
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Hence 


Cj + 2 \ _ 0 

c 2 + 2k e 2 - 0 


+ 2X. €. = 0 


and 



Thus, from Equation 96, 



or 


and 


From Equation 97, 


€ i = ± 


Cj /N e 
)/i c? 


€. 

J 


c. /N 6 

±~2 . 

Jlc* 

j 


But 


Ay. 


I A | 


c 2 . 
) 



i i 



0 i 

1 A 


and, using Appendix C, Equation CIO, 


Zc j = |A|2 [ P S (U) + 3P ?( U ) + • • • + (2k - 1) P k 2 M (u)] • 


(99) 


(iprrt 


( 101 ) 
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Thus 


Ay. max = T /Pg(u) + 3Pj(u) + . . . + (2k - 1) !>«., (u) 


( 102 ) 


where 


i =N 


u + 1 
2 


Comparing this result with Equation 17, we see that with e = the maximum error Ay iinax is /n 
times larger than rj i for uncorrelated noise. 

The error function is given by Equation 101, which also may be written 


e. 

j 


NJe 

I A | /p*(u) + 3P*(u) + . . . + (2k - 1) P*., (u) 


0 3 

1 A 


(103) 


where i is the point at which Ay. is maximized. 


GENERALIZATIONS 

The polynomial in Equation 4 may be written 

k 

y* = 2] (i)i_1 Vi • 

j=i 

where k is the number of degrees of freedom. Equation 104 may be generalized to 


(104) 


y f 



(105) 


where Z. are function of i and j . In this form Equation 105 includes linearized nonlinear systems 
such as described in Reference 6, Appendix B. The sums of the residuals is 


S 




(106) 


where the summation in i is taken over the N measured values y t . 
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The conditions for a minimum are 


5s 




= 0 


or 


N k in 

^ij ^iv a j - y ‘ y i ^iv 
i -1 j = 1 i =1 



( 107 ) 


where v takes the integer values from 1 to k. The sums are interchangeable, and Equation 107 may 
be written 


where 


Solving for 3j yields 



vj 


L 


z z 

1) IV 


C 11 C 12 ' ^ y i Z il 

^21 *"22 ’ ’ ’ ^ y i ^ i 2 



(108) 


(109) 


( 110 ) 


0 k i 0 k2 • • • Zy i Z ik C kk 


where 


I C = 


C 11 ‘ C lk 


C ki • • • c kk 
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Insertion in Equation 105 yields 


or 




j=i i=i 


"2 1 


"kl 


"12 


"22 


"k2 


Z ;1 


12 


ik 


"lk 


"2k 


"kk 


y-i 


r =1 


z.. 


"21 22 


"rk kl 


z ik 


'2k 


y r 


(111) 


where the summation index r is identical with the previously used summation index i. In Equa- 
tion 111 we recognize the generalized form of Equation 8. In analogy to Equation 10, the brief 
notation 


Vi 



r =1 I <■ 



(112) 


is introduced. 

For uncorrelated noise with standard deviation a e , we obtain the standard deviation tj. of the 
estimate y i : 


2-^1 N 
“ Icl* 

r=l 


<L 


0 z i 

2 

0 z 


_ 

1 

z c 

~ Id 

z c 

r 


1 


which is the generalized form of Equation 14. 

For the rms standard deviation^, defined by 


N 


v 2 = A 

i =1 


(113) 
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we obtain 


z. 

1 

c 


(114) 

This equation is identical with Equation 23, which thus holds true for the generalized case. 

We have found that Equations 8, 14, and 23 hold true for the generalized case. In particular, 
they hold true for polynomials fitted to unequally spaced data. It should be pointed out that no ap- 
proximations have been made in the derivation of these equations; they are exact. 

The generalization of the equations for correlated data is unfortunately not possible, one of 
the reasons being that p. is not defined for unequally spaced data. 


or 


n2 = 




z 


— 2 _ rv 2 

-n ~ n °\ 
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Appendix A 


Derivation of y 


N 

•■raZ: 

j=l 


0 j 


i A 


From the Equations 7, where all summations are from 1 to N 


+ a l ^ j 1 + • • 

. + a k . 1 Sj«=Zj«y J 

+ a x 2 j 2 + . . 

• +a k .j 2 j k =2 j yj 

1 + aj 2 j k + . 

' ' + a k-i 1 j 2k 2 = 2 ^ lt_1 y i 


we can solve for the coefficients a„. With 


j=l 


we obtain 


I A | 


A o A i 


A 1 A 2 


A,-! A v + 1 • • • Vi 

A„ Zjy. A v+2 ■ ■ ■ \ 


A k-1 \ ■ ' ‘ Ak + v-2 ^ " '■'j A k + t' ’ ’ * A 2k-: 


where 


(Al) 


A = 


A 0 * * * \-i 


K-i • * • A - 


2k“2 


(A2) 
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Thus 



f 


A i • 

■ Vi 


A o 


A 2 

•v, 

yi = |A|^ 


Sjy, 

A 2 

• \ 

+ 



A 3 

• \ 


V 

2 j k_1 y. 

V 

' * A 2k-2 


V, 

2 j k_1 y. 

vr 

• A 

2k"2 


V-A-2 

A i ' ’ ‘ s i Vj 


A 


> ' 


(A3) 


2k-3 


:k-l 


but 


> 

o 

2 *i • 

• • V, 



> 

O 

* A k-i 

A , 

Xi yj • 

• ■ \ 

= - 

x jy, 

V • 

• \ 

S’ • 
1 

X j k_1 yj • 

■ ■ A 2k-2 


x y k_1 yj 

\-i * 

' A 2k-2 


(A4) 


By rewriting all the determinants with the sums in the first column we obtain 


0 

1 

i . . . i* 1 " 1 



O 

< 

V 

* A k-i 


Xj yj 

A , 

v- 

• \ 

(A5) 

j k_l Yj 

A k-1 

A k* ' * A 2k-2 



t 


Expanding the determinant after the first column reveals that the summation may be moved 
outside the determinant, y. is a common factor in the first column and may also be moved 
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outside the determinant. Thus 



or, with shorter notations, 


(A6) 
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Appendix B 

N 

The Summation of 

j=i 




Writing out the determinant in more detail, we have 
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If the summation variable only occurs in a row or a column, the summation over the whole deter- 
minant may be replaced by summation of the elements of the row or column, thus: 


I 

; =1 



This is easily verified by expansion into minors. 

By applying this rule twice and observing that by definition 

1=1 

we obtain 



(B2) 
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But 
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> 

o 

> 

to 


J> 

> 

o 

> 

to 


A 2 A 0 A 1 * * * 

A 1 A 2 A 3 


A 2 A 1 A 3 


A 3 A 1 A 2 * * * 

A 2 A 3 A 4 

+ 

A 3 A 2 A 4 


A 4 A 2 A 3 


= -k | A | , (B4) 

where k is the degree of freedom of the least-squares fitted polynomial. Thus 

o i 
j A 


= k A 


(B5) 
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Equation 9 defines k v : 


Appendix C 


Evaluation of 



for Large N. 


N 



i "1 


(9) 


It is shown in Reference 3, page 4, that 


** = E L ' 

1 


jv+l 


1 V 

V + 1 2N 12 N 2 


(Cl) 


and, for large N, 


pt +1 

V + 1 


(C2) 


This is the same approximation as 



(C3) 


The error introduced in |a| by this approximation is of magnitude N' 2 . By subtracting rows and 
columns in a suitable fashion, the N'-' term may be eliminated: 




row p 



row p + 1 



A -t + p-2 %p-l • * • 

A ^ + p-l A -t+p ■ • • 
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Subtract p/2 times row p from row p + 1. Thereafter, subtract 1/2 times column l from column 
l + 1. The element of row p + 1 and column l + 1 of |a| is then 


A 4 +p -f A ^p-l -J ( A U P -l ~ \ A ^p-2 


N't+p+i n^ + p 
■£+p + l + 2 + ' 

^'t+p + 1 


p (N^p 


2 yfc + p 


\ l /N^ + P 

’ “2 + p + 


+ terms of order n^ + p ” 1 and lower. 


"t + P + 1 

The error introduced by the approximation is thus of order N" 2 . With the above approximation, 


0 i 

1 A 


0 

1 

i 

. i^-i 


0 

1 

x 

. X k_1 

1 

N 

N 2 

N k 


1 

1 

1 

1 



2 

k 




2 ’ 

* k 


N 

N 3 

N k+i 

□ n“ 2+1 


1 

1 

1 


2 

3 ’ 

' ‘k + 1 


X 

2 

3 

k + 1 

ik-1 

Nk 

N k+I 

N 2k_1 


x k_ 1 

1 

1 

1 


k 

+ 

* ' 2k - 1 



k 

k + 1 

2k - 1 


where x = i/N. For more rapid evaluation of the determinant, we make the substitution 

u + 1 
x= — 

and observe that 


(C4) 


H 1 ) 

N)* 


1 

1 

1^ 

2 

3_ 

3 


C44 • ■ M 


1^ 

2 

£ 

3 

1_ 

T 


/u + lV*' 1 £ 1 

\ 2 ) k k + 1 


k + 1 

1 

k + 2 


2k _ 1 


2 k 2 -k 


1 u u 2 


1 0 T 


0 - 
3 


u 2 I 0 1 


(C5) 
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ihis result may be verified by subtracting rows and columns in a suitable fashion. For j a! we have 


N 

N 2 

N k 


1 

1 

1 

2 

IT 


1 

2 

k 

N 2 

N 3 

N k+J 


1 

1 

1 

2 

T 

' ' k + l 

= N k2 

2 

3 

k + l 

N k 

N k+1 

N 2k-1 


1 

1 

1 

k 

k + l 

2k- 1 


k 

k + 1 

2k - 1 


From Reference 7, pages 429 to 431, we obtain 

|A| = N k2 [2! 3' • ■ ■ (k - 1)!P 
k! (k + 1)! . . . (2k - 1)! 

Combining Equations C4, C5 and C7, we obtain 


(C6) 


(C7) 


0 1 u • • . u k_1 


0 i 

1 A 


|A| 


k! (k + 1)! ■ ■ ■ (2k - 1)! 

N . 2 k 0<"i ) [2! 3! • • . (k - 1> ! ] 3 



(C8) 


U 


k“l 


By subtracting the second column from the other columns we obtain 


0 1 u u 2 * * ♦ 


- 1 1 u u 2 - — . . . 

3 

1 1 o I • • • 

3 


0 10 0 • • • 

u 0 - 0 . . . 

3 


u 0 I 0 • • * 

3 

u 2 A 0 I . . . 
3 5 


2 1 1 n 4 

3 3 45 


and the order of the determinant is reduced by 1. 
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Repeating the process, we obtain 


0 i 

1 A 


I A | N 
+ 9 


1 

1 + 3 u 2 + 5 ( 3 u2 “ 1 

)\y ( 5u3 - 3u V 


N 

\ 2 

V 2 / 


/ 35 u 4 - 30 u 3 + 3^ 2 j n 

[63 u 5 - 70 u 3 + 1 5 u^ 2 


V 

8 ) 

\ 8 ) + ' 



The polynomials in the squared parenthesis are the Legendre polynomials; thus 


0 i 


| A | = "N [ P o (u) +3P ? (U) + • ' 

• + (2k - 1) P 2 ., (u)] 


where 


i - N 


u + 1 


(C9) 


(CIO) 
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Appendix D 


Evaluation of v for Correlated Data 


From Equation 27, 


v 2 =- 


n |a | 2 


N N | ^ . 

LL\° a 

H=i i=i 


+ • • ■ + 2 p 


i=l j=l 


0 j 


0 j + v 



i A 


i A 

+ * 



With the substitution i = j + v we obtain 


N N-V , N N 

rro j _ o j+.iy 1 y n |0‘t-v 

L—i Z_j | i A i A I Z_ i I i A 

1=1 J =1 i = l 'fc-v+l 


0 l 

1 A 


N N - 

m v- 

i=1 4=i 


1=1 


0 l 

1 A 


(Dl) 


N N 

i=1 -e-i 


't - 

A 


;il-zz 

i=1 ^=i 


0 

0 1 l 

1 

i A 


0 1 l 

1 

i 2 A 


1 't - v 


A 1 *2 
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0 1 £ - v ("t - v) 2 . . . 

1 

l 


N 



The summation of the first determinant is given by Equation B4. The second determinant is ex- 
panded in minors after the first row: 



44 


because two columns are identical in each determinant. In the same manner we may verify that all 
the other minors are zero. Hence 



For the second term in Equation D1 we obtain 




0 

l A 


(D4) 


(D5) 


Expansion in minors of A yields 


II IS Vl = Z 

4=i 4=1 


n 


A. * 5 


6 


(A, 


22 


4 A, 


13 


) +■ 


(D6) 


observing that A.. = A.. , where A., are the minors of |a| . With the approximation k v - N v+1 /v + 1 , 
we find in the same manner as in Equation C6 that 


is of order k 2 -l in N 
A 1 2 , A 2 1 are of order k 2 - 2 in N 
A 1 3 , A 22 . A 31 are of order k 2 - 3 in N . 


Thus, taking the dominating terms only, 


i=1 4 


0 

1 


0 i 

1 1 A 


* A 


vA n | A| - — (A 22 -4A 13 ) |A| +. 
6 


(D7) 
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With the approximation k v - N v+1 /v + 1 we have 


1 L L 1 

3 4 5 k + 1 


i_ i_ j_ i_ 

4 5 6 k + 2 


A u = N k 


_1 

6 7 


1 

k + 3 


1 1 1 . . . 1 

k + 1 k+2 k + 3 * 2k - 1 


The rows are multiplied by factors so that l’s are obtained in the last column: 


1 

1 


k+1 

k + 1 

1 

3 

k + 1 

k! 

3 

k 

. 


" (2k - 1)! 



• 

1 

1 


2k _ 1 

2k - 1 

1 

k + 1 

2k - 1 

1 

k+1 

2k - 2 



and, by subtracting the bottom row from the other rows, 


(k-2) 2 (k-2)(k-3) ... k-2 

3(k + 1) 4 (k + 2) k(2k - 2) 


1 _J_ 

3 * ‘ ' k + 1 


(k - 2)(k ~ 3) (k-3) 2 

4(k + l) 5(k+2) 


k-3 

(k+1) (2k -2) 


0 


k! 

(2k- 1)! 


1 . . . 1 
k+1 2k - 1 


2k - 2 
k(k + 1) 


(2k -3) (2k -2) 


2k - 1 


2k - 1 


k + 1 


2k - 2 


1 


Taking out common factors, 


1 

i 


1 

1 

3 

k + 1 

[(k - 2)! k! ] 2 
“ (2k - 2)! (2k - 1)! 

3 

k 

1 

1 


1 

1 

k + r * 

2k - 1 


k 

2k - 3 


Successive application of this recurrence formula yields (see also Reference 8), 


k + 1 


k + 1 

or, using Equations C7, D8, and DIO, 


2k - 1 


[2! 3! • • • (k - 2) ! ] 3 (k - 1) (k!) 2 
k! (k + 1) ! • • • (2k - 1)! 


*ir ,Al 


With the same procedure it may be shown that 




where g(k) is a function of k alone. We thus obtain, in decreasing degree of n, 

k 2 


V =- 


_1_ 
N I A I 


k I A | 2 + 2 ^ Pv (k | A | 2 - |A| 2 ~ ^ ^ |A| 2 + ...] 




or 


(D9) 


(DIO) 


(Dll) 


(D12) 


ko 2 


V = ■ 


1 + 2 


N-l N-l N- 1 

i 1 i -J 


(D13) 
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Appendix E 

The Autocorrelation Function of Range Rate 


It is shown in Reference 8 that the Doppler count A0 may be written 


N> = <£(t + h + T p ) - 0(t +h) - [<f >( t +T p ) -<£(t)] , (El) 

where 

= phase difference, measured by Doppler count 
t = reference time 
h = sampling interval 
T p = two-way propagation time 
<£( t) = phase transmitted at time t. 

We consider the case where the phase is contaminated by a random-walk phase noise <£ RW . The 
standard deviation of the noise accumulated during a time interval AT is 

= E[^ RW (t+AT)-V(t)] 2 = kj AT , (£2) 

where k l is a constant. 

We consider the case where the two-way propagation time is larger than the sampling 
interval h: 


T > h . 

p 


This situation is shown in Figure El. The 
standard deviation 07^ of the Doppler count 
is then, according to Equation El, 

a U RW = E[< £rW (t +h+T p)"^RW (t +T p)] 2 

- E[<£ rw (t +h) -<f> RW (t)] 2 

and, using Equation E 2 , 

ct A^ rw = 2k ?h . (£3) 


* 



Figure El— Phase vs. time for h < T p . 
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Figure E3— Standard deviation of 
phase noise due to random walk. 


If, on the other hand, T p < h, we obtain 
from Figure E2: 

CT A* Rt = (t + h + T p )~ <£ rw (t +h)] 2 

+ E ^RW ( * + fp ) “ ^RW ( t )] 

or 

= 2k?T„ • ( E4) 

The standard deviation a ^ for the Doppler 
count A£(nh) over n sampling intervals is ob- 
tained from Equations E3 and E4 and is shown 
in Figure E3 as a function of n . The two-way 
propagation delay is 

T p = ( P + x)h, (E5) 

where 

p = integer 

0 < x < l 

h = sampling interval. 


For the time interval 2h, we obtain from Equation E3: 


= Wrw (2h) } 2 = 4k?h . 


(E6) 


But we can also consider the interval 2h as two intervals h +h. If p 1 is the correlation coefficient 
between these intervals, then 


E(A0 rw ( 2h ) } 2 = E{A^ RW (h)} 2 (1+ l + 2 Pl ) = 4k? (1 + Pl )h . (E7) 

Comparing Equations E6 and E7, we find: 


Pi - 0 . 


(E8) 
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In the same manner 


P 2 = o 

Vi = 0 ■ 

where 

p v = correlation coefficient between samples which are v sampling intervals apart. 
Consider now p + 1 sampling intervals. By summing p + 1 intervals, we obtain 


(E9) 


E{^ rw [(p + 1 ) h] } 2 ° 2kJ(p + l +2 Pp )h . 

From Figure 12 and Equation E5, we also obtain 


(E10) 


E { A ^rw [(p + l)h]} 2 ' 2kJ (p+x)h 


(Ell) 


and hence 


1 'X 
~ 2 * 

For p + 2 sampling intervals, we obtain in the same manner 


(E12) 


2 kj (p + 2 +4 p p +2p p+1 )h - 2 k J (p + x) h 

and thus 

P p+ i = - T * (El 3) 

For p + 3 sampling intervals, we obtain 


2kj (p + 3 + 6p p +4 p p+1 +2p p+2 )h - 2 k* (p + x)h 


or 


p 


P + 2 


= 0 . 


(E14) 
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In the same manner, 


p n - 0 for n > p + 2 . (E15) 

If AR is the change in range during the sampling interval h, we may write the (average) range 
rate R: 


R 


AR 
h ’ 


where ar is proportional to &t>. The correlation coefficients or normalized autocorrelation functions 
for R are thus the same as for A£. See also References 9 and 10. 
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Appendix F 


The Evaluation 


N 

V“» 


ion of / (Y. - y .)2 


From Equations 10 and 83, 


Vi = 



Y. 

j 


+ e i 


we obtain 


Vi 



(FI) 


It may be shown that 


l 

Hi 



if Y. is of equal or lower degree than y.. This result is self-evident because y . = Y. if all e. = 0, 
or may be derived by evaluating the sum in the same manner as in Appendix A. We thus obtain 


and 


Y. -y. = — L- 

i I * I 


j=l 


1° Jl 

_ _1_ 

o 

M 

m 

1 i A| 

' I A | 

i A 1 



— r r 

1*1* 4 ' 11 



(F2) 


(F3) 
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where 


0 £e. £j e. £ j 2 €j • • • 

1 A„ Aj A 2 

i A, A 2 A 3 • • • 

i 2 a 2 a 3 a 4 • • • 


Summing over i gives 




Ii£ i 

A 



2 € . 

j 

\ 


2 6 . 
) 

\ A 2 ••• 


- 2 6 . 

J 


a 2 ••• 

+ £j 

He. 

\ a 3 ••• 

“ * ' * 


(F4) 


Multiplying the sums into the determinants results in elements of the form £j p e j £j q e. . If the 
data is uncorrelated, then 


1 im 

N-»oo 



j q 6. 6. = 0 

J i J 


i t j . 


and thus, with r = p + q, 


L 



N 



j = l 


for large N. Furthermore, 


L 

i = l 


N N & N 

4-Z> £< 4£<; • 

j =1 j=l jal 


(F5) 


(F6) 


(F7) 


which may be shown by induction by going from N to N + 1 and is obviously true for N = 1 . 
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Equation F4 is thus reduced to 


E <Vi - ir ‘ > ' 


2e 2 

) 

N | A 



and hence 


In the same manner, 


P n = 0 for n > P + 2 . (F15) 

If AR is the change in range during the sampling interval h, we may write the (average) range 
rate R: 


R = 


AR 

h 


where ARis proportional to A£. The correlation coefficients or normalized autocorrelation functions 
for R are thus the same as for A0. See also References 9 and 10. 
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